Deep Web
What is Deep Web? And how is Deep Web defined?
Deep Web is defined as text pages, files or other information accessible via the WWW, which web search engines do not include in their index. Specifically, servers shows the visible part of the Internet for us, or the Surface web, makes up only about 4% of the total capacity of the Internet, and therefore 96% of the entire Internet is the deep web. Deep web is shrouded in mystery. For the most part, however, this is not sensational, but it can also be a conscious attempt to censor certain content.
Deep Web is devided into:
Sites that offer illegal content - such as gun sales, child pornography, etc.
Dynamically changing pages - a web page generates unique content each time it is viewed individually.
Protected content - a password is required for access, resp. meeting the set conditions (user registration, etc.)
Private website - the website administrator does not want the content of the robot to be indexed and therefore will not allow it
Unreadable content - robots cannot read content. E.g. PDF, compressed files, running programs, etc.